WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 



PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 


(51) International Patent Classification 7 : 

H04Q 7/34, H04L 1/24, H04B 17/00 


Al 


(11) International Publication Number: WO 00/69196 

(43) International Publication Date: 16 November 2000 (16.1 1.00) 


(21) International Application Number: PCT/FIOO/00402 

(22) International Filing Date: 5 May 2000 (05.05.00) 


(30) Priority Data: 
991062 


7 May 1999 (07.05.99) 


FI 


(71) Applicant (for all designated States except US): NOKIA MO- 

BILE PHONES LTD. [FI/FI]; Keilalahdentie 4, FIN-02150 
Espoo (FI). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): NOKKONEN, Esa 
[FI/FI]; Isosuonkatu 4 G, FIN-33400 Tampere (FI). NUM- 
MINEN, Jussi [FI/FI]; Liinahaankatu 26 as 1A, FIN-20320 
Turku (FI). LINTINEN, Markku [FI/FI]; Myllystenpoh- 
jantie 27 A 5, FIN-36200 Kangasala (FI). KINNUNEN, 
Jukka [FI/FI]; Pintakatu I, FIN-33400 Tampere (FI). 
SAVOLAINEN, Juha [FI/FI]; Saarenvainionkatu 15 D 
52, FIN-33710 Tampere (FI). JOK1TALO, Pekka [FI/FI]; 
Nokelantie 32, FIN-90140 Oulu (FI). 

(74) Agent: BERGGREN OY AB; P.O. Box 16, FIN-00101 
Helsinki (FI). 


(81) Designated States: AE, AG, AL, AM, AT, AU, AZ, BA. BB, 
BG, BR, BY, CA, CH, CN, CR, CU, CZ, DE, DK. DM, 
DZ, EE, ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL, 
IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, 
LV, MA, MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT, 
RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM. TR. TT. TZ. 
UA, UG, US, UZ. VN, YU, ZA, ZW, ARIPO patent (GH. 
GM, KE, LS, MW, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, 
IE, IT, LU, MC, NL, PT, SE), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA. GN, GW, ML, MR, NE, SN, TD, TG). 


Published 

With international search report. 

In English translation (filed in Finnish). 


(54) Title: METHOD AND SYSTEM FOR TESTING THE FUNCTIONING OF A TESTING ALGORITHM IN A COMMUNICATION 
DEVICE 



(57) Abstract 

The invention relates in general to the testing of the functioning of radio and other communication devices. In particular the invention 
relates to the testing of the functioning of a digital radio device on the basis of error statistics. In order to test functions relating to data 
communication a simulation system produces a pseudorandom bit sequence or other test sequence which is packed into downlink frames 
and transmitted to the communication device tested. In accordance with the invention a known number of errors are produced in the test 
sequence. When the communication device tested compares the received test sequence to a sequence it has produced Itself, it detects the 
errors in the received sequence and produces various error statistics in the form of bit error ratio (BER) or frame erasure ratio (FER), 
for example. An uplink communication connection is used to convey these statistics to the simulation system which examines whether 
the information provided by the communication device tested matches the simulation system's information about the erroneousness of the 
sequence transmitted downlink. 
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Method and system for testing the functioning of a testing algorithm in a com- 
munication device 


The invention relates in general to the testing of the functioning of radio and other 
communication devices. In particular the invention relates to the testing of the func- 
tioning of a digital radio device on the basis of error statistics. The description of 
the invention especially focuses on type approval testing of the functioning of a 
radio device but the functioning of radio and other communication devices is of 
course tested in many other contexts as well, e.g. during product development, 
manufacture, repair and service. In addition, the invention is applicable even during 
the normal use of the radio or other communication device. 

New digital radio devices, such as digital mobile phones, for example, intended for 
operation in public data networks, are tested for type approval prior to being intro- 
duced into the market. The equipment and methods used in the testing are usually 
defined in data network standards. Fig. 1 illustrates a known test arrangement in 
which testing is directed to a mobile station (MS) 101 of a cellular radio system. 
The mobile station may also be called user equipment (UE). A simulation system 
(SS) 102 simulates a cellular radio system during the test. In this application such a 
system is called a simulation system or test system. Testing the functioning of data 
transmission requires that an active communication connection 103 be set up be- 
tween the SS and MS, which may be a radio connection or a wire connection 
through a test interface at the mobile station. 

Tests usually apply a technique in which a mobile station receives a downlink frame 
from the SS and sends back to the SS a corresponding uplink frame which contains 
the equivalent number of bits. The mobile station may even recycle to the SS the 
same individual bits that it received in the downlink direction. The SS examines 
whether the transmission or the operation of the mobile station caused errors in the 
frame. Arrow 104 depicts the loopback. The arrangement has been suitable for 
testing the mobile stations of known cellular radio systems since in the known sys- 
tems the communication connections are bidirectional and their capacity is dis- 
tributed symmetrically: the capacities of uplink and downlink communication are 
equal. In mobile stations of new cellular radio systems, however, it is necessary to 
test functions that involve asymmetric distribution of communication capacity 
between uplink and downlink directions. Moreover, mobile stations of new cellular 
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radio systems may include functions based on unidirectional downlink communi- 
cation the testing of which is naturally impossible using the method according to the 
prior art. 

From an earlier Finnish patent application no. 981267 by the applicant, which 
5 application has not become public by the priority date of this present application, it 
is known an alternative testing procedure suitable for the testing of data communi- 
cation arrangements with asymmetric capacities. In said procedure a mobile station 
selects from the bits of the downlink frame only a portion which is looped back to 
the uplink frames. The disadvantage of such an arrangement is that errors in those 
10 bits of the downlink frame that are not looped back uplink will remain undetected. 
In addition, this arrangement, too, is unsuitable for testing unidirectional downlink 
communication connections. 

From an earlier Finnish patent application no. 990690 by the applicant, which 
application has not become public by the priority date of this present application, it 

15 is known a testing procedure in which the mobile station tested does not need to 
recycle the transmitted data back uplink. This procedure is based on the fact that the 
mobile station can produce the same pseudorandom test sequence that the SS in- 
cludes in the test frames sent downlink. The mobile station compares the test se- 
quence received to the sequence it has produced, produces statistics of the errors 

20 detected in the sequence received, and sends uplink to the SS the quantity of errors 
detected as such and/or a parameter representing the quantity of errors. A dis- 
advantage of this testing procedure is that it depends on the operation of the algo- 
rithms^ by the mobile station to produce the reference sequence and to detect 
errors. 

25 An object of the present invention is to provide a method for testing the functioning 
of a digital communication device, in which method the dependence on the correct 
internal functioning of the communication device is lesser than in the procedure 
according to the prior art described above. Another object of the invention is to pro- 
vide the equipment needed to implement the method according to the invention. 

30 The objects of the invention are achieved by examining how the communication 
device tested processes a test sequence the erroneousness of which is known. 

The method according to the invention is characterized in that it is comprised of 
steps in which 

- a first test sequence is produced, 
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- known errors are generated in the test sequence to produce a second test sequence, 

- the second test sequence is sent to the communication device tested, 

- the communication device tested produces a third test sequence corresponding to 
the first test sequence, 

5 - the communication device tested compares the second test sequence to the third 
test sequence to detect differences between the test sequences, and 

- the communication device tested sends to the simulation system information rep- 
resenting the differences detected. 

The invention is also directed to test equipment which is characterized in that it 
10 comprises 

- a test sequence generator to produce a test sequence, 

- an error generator to produce errors in said test sequence, and 

- a comparator circuit to compare the errors produced with the errors detected by the 
communication device tested. 

15 In order to test functions relating to data communication the simulation system pro- 
duces a pseudorandom bit sequence or other test sequence which is packed into 
downlink frames and transmitted to the communication device tested. In accordance 
with the invention a known number of errors are produced in the test sequence. The 
test sequence is sent to the communication device tested preferably under signal 

20 propagation conditions so good that it is unlikely that the quantity or quality of 
errors would substantially change prior to that point in the communication device 
tested where the correctness of the received sequence is analyzed. When the com- 
munication device tested compares the received test sequence to the sequence it has 
produced itself, it detects the errors in the received sequence and produces various 

25 error statistics in the form of bit error ratio (BER) or frame erasure ratio (FER), for 
example. Such generation of error statistics can be realized in the same way as 
described in the applicant's earlier application mentioned above. An uplink commu- 
nication connection is used to convey these statistics to the simulation system which 
examines whether the information provided by the communication device tested 

30 matches the simulation system's information about the erroneousness of the 
sequence transmitted downlink. 

The method according to the invention does not call for a high uplink transmission 
capacity since the only information sent uplink is the information about the errors 
detected in the received test sequence by the communication device tested. The 
35 uplink communication connection need not be associated with the downlink com- 
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munication connection at all. A so-called Bluetooth interface has been proposed for 
new electronic apparatus to provide a short-range wireless communication con- 
nection between at least two apparatus. The communication device tested can send 
infonnation about the analysis results to the test equipment over the Bluetooth inter- 
5 face. Naturally the uplink channel of a bidirectional communication connection can 
be used in the uplink direction, if one is available. 

The testing method according to the invention is also relatively independent of the 
internal functions of the communication device tested since the comparison of de- 
tected and known errors in the testing system does not depend on the error detection 
10 method used by the communication device tested. The testing system may vary the 
quantity and quality of errors generated in the test sequence so that it can be exam- 
ined how well the communication device detects errors of various types. 

The invention does not in any way limit the amount of information sent uplink by 
the communication device tested to report detected and statistically processed 
15 errors. However, the method according to the invention is at its most efficient when 
the information sent uplink represents the detected and processed errors relatively 
accurately, e.g. in such a manner that the communication device tested reports sepa- 
rately the measured bit error ratio of each downlink frame. 

The invention is below described in more detail referring to the preferred embodi- 
20 ments presented by way of example and to the accompanying drawings in which 

Fig. 1 illustrates testing according to the prior art, 

Fig. 2 illustrates the principle of the invention, and 

Fig. 3 illustrates the method according to the invention in testing. 

Above in connection with the description of the prior art reference was made to Fig. 
25 1, so below in the description of the invention and its preferred embodiments refer- 
ence will be made mainly to Figs. 2 and 3. 

Fig. 2 shows an arrangement in which a mobile station 202 of a digital mobile 
communications system, which mobile station is to be tested, is connected in a 
known manner to test equipment 201. It is usually advantageous from the testing 
30 standpoint that the mobile station 202 be equipped with a subscriber identity module 
(SIM) 203 designed specifically for testing purposes, which SIM may be a smart 
card like the SIM card widely used in mobile stations or a special SIM simulator 
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which establishes the necessary connections between the SIM interface at the 
mobile station and special equipment simulating the operation of a SIM. However, 
the invention does not require the use of any particular SIM. 

In a known manner the test equipment 201 comprises a test sequence generator 204 
5 which is initialized using a certain so-called seed number 205 and which then pro- 
duces a pseudorandom test sequence. The mobile station 202 comprises a function- 
ally identical test sequence generator 206 which also is initialized using a certain 
seed number 207. It follows from the general principles applying to pseudorandom 
test sequence generators that if the seed numbers 205 and 207 are identical, gen- 
10 erators 204 and 206 will produce exactly identical pseudorandom test sequences. 

The mobile station 202 also comprises a comparator circuit 208 and statistical unit 
209 which are adapted so as to compare bit by bit the test sequence received from 
the test equipment to the locally produced test sequence and to compile statistics of 
the differences detected. In addition, there is an uplink connection from the statisti- 
15 cal unit 209 back to the test equipment so that the resulting statistics can be trans- 
mitted to the test equipment. This connection may be an uplink channel in the same 
communication connection via which the downlink signal was transmitted from the 
test equipment 201 to the mobile station 202 or it may be some other connection 
such as a Bluetooth connection. 

20 For the comparison of pseudorandom test sequences to be meaningful, the test se- 
quence generators 204 and 206 must operate in a synchronized manner, i.e. they 
have to generate the same bits at the same pace. The synchronization of the genera- 
tion of test sequences is known per se because in spread spectrum technology in 
general and specifically in code division multiple access (CDMA) methods the dif- 

25 ferentiation of a given utility signal from rivaling utility signals and noise is based 
on using one and the same pseudorandom spreading sequence at both the transmit- 
ting and receiving end. In connection with the invention it is possible to use a prior- 
art technique to synchronize the generation of the test sequences. In Fig. 2, syn- 
chronization is schematically depicted by an arrow 210. 

30 Over the uplink connection it is possible to transmit e.g. a stored bit error ratio or 
frame erasure ratio value or a value derived from them, such as a mean bit error 
ratio over a time span. Many applications are only interested in whether the bit error 
ratio or frame erasure ratio stays below a predetermined limit, in which case only a 
yes/no type answer (is smaller than limit value / is not smaller than limit value) need 

35 be sent uplink. Since limit values are usually defined as exponential numbers (say, 
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1.0 • 10 -6 ), one possibility is to sent uplink the exponent x of the number 1.0 • 10* x 
which represents the upper limit value of the observed bit error ratio. Thus e.g. 
number -6 transmitted uplink would indicate that the observed bit error ratio is 
smaller than 1.0 • 10" 6 . 

5 In accordance with the invention the test equipment includes an error generator 211 
operating in a controlled manner such that it can produce a certain known errone- 
ousness in any given test sequence. The error generator 211 can produce errors in a 
test sequence partly pseudorandomly, i.e. in such a manner that a given portion of 
die test sequence has an exact known number of errors but their placement within 

10 that portion is random. The error generator 211 may also operate in such a manner 
that it produces an exact specified bit error pattern which e.g. has at K-bit intervals 
a period of N bits, where the value of every M A bit has been altered. Here, K, N and 
M are positive integers, whereby the control circuit (not shown) controlling the 
operation of the error generator can accurately control the generation of errors by 

15 providing the error generator with the desired K, N and M values. Many combina- 
tions and modifications of these techniques are also possible. 

In accordance with the invention the test equipment also includes a comparator 
circuit 212 which is informed about how many and what kind of errors the test 
sequence includes at the moment of sending to the mobile station in downlink 

20 transmission frames. This information may come from the error generator control 
data, as depicted in Fig. 2 by a continuous line, or the comparator circuit 212 may 
receive copies of the downlink frames delivered to the mobile station tested. The 
latter option is depicted in Fig. 2 by a broken line. When the mobile station tested 
sends to the test equipment the information about the detected errors, the informa- 

25 tion is directed to the comparator circuit 212 in the test equipment. The comparator 
circuit 212 can then examine whether the information from the mobile station tested 
matches the information representing the erroneousness of the test sequence at the 
moment of sending. 

The earlier Finnish patent application no. 990690 by the applicant, mentioned above 
30 in the description of the prior art, discloses various options to realize a test loop in 
the mobile station tested. A test loop refers to those parts of the hardware and soft- 
ware implementation that in the mobile station tested realize the functions for 
receiving, demodulating and decoding the test sequence, detecting and processing 
errors, and for sending the error data to the test equipment. The present invention 


WO 00/69 1 96 PCT/FI00/00402 


does not set any additional requirements on the mobile station tested but it can 
operate exactly as disclosed in said earlier application. 

The earlier application mentioned above as well as an earlier Finnish patent appli- 
cation no. 981267 by the applicant also discuss the advantages achieved if the test 
5 loop is produced without contribution from certain upper protocol layers. This 
refers particularly to a so-called mobility management (MM) layer and protocol 
layers above it in protocol stacks intended for connection set-up and management. 
The present invention is independent of the protocol layers used for setting up and 
managing the test connection. The invention does well e.g. when using a procedure 
10 based on the utilization of lower protocol layers only, as described in the applica- 
tions mentioned above. 

Fig. 3 shows an exemplary testing method applying the invention. The mobile 
station tested is connected in a known manner to the test equipment and test SIM. A 
mobile terminating (MT) radio connection is established between the mobile station 

15 and test equipment in accordance with Fig. 3. When the mobile station is on, the test 
equipment sends to it on a PCH channel a paging request 301, to which the mobile 
station responds with a channel request 302 sent on a RACH channel. After that, the 
test equipment sends an immediate assignment message 303 which may include 
various instructions for the mobile station. The mobile station sends to the test 

20 equipment a set asynchronous balanced mode (SABM) message 304 which in fact is 
a paging response and is sent on a SDCCH channel. The test equipment acknowl- 
edges the SABM message using an unnumbered acknowledge (UA) 305. 

The contents and syntax of the messages shown in Fig. 3 are mainly defined in 
specification GSM 04.08. However, some messages have portions reserved for 

25 future extensions, which portions can be used to utilize the messages for the present 
invention. Particularly the immediate assignment 303 contains so-called rest octets 
in which the first two bits indicate the contents of the rest of the rest octet By the 
priority date of this patent application, values 11 and 10 of the values of the first 
two bits of the rest octet have been reserved but values 01 and 00 are unused In 

30 accordance with an advantageous embodiment of the invention at least one of these 
values can be reserved to indicate that in response to the immediate assignment 303 
the mobile station to be tested has to set itself in a special test mode. The test mode 
is advantageously defined such that even though an RR-level connection between 
the mobile station and test equipment has already been established, the RR layer in 

35 the mobile station's protocol stack will not inform the upper MM layer about the 
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connection. As the MM layer and higher protocol layers do not know about the 
existence of the radio connection, they will not try to disconnect it because of a 
supervising mechanism which would e.g. attempt to monitor the error status of the 
connection. 

5 So test mode means that the mobile station to be tested is instructed to maintain a 
connection on a certain transmission channel. The mobile station is kept in the test 
mode by Layer 3 signaling. Defining the test mode as described above and realiza- 
tion of the definition in practice can be easily implemented by a person skilled in 
the art since the operation of the mobile station is totally controlled by its control 
10 block. The control block in turn is a microprocessor which executes a program 
stored in the memory means available to it. When this program is written such that 
in response to the reception of a certain Layer 3 command no notification is sent to 
upper protocol layers, the mobile station can be made to function in the desired 
manner according to the invention. 

When a connection has been established, the test equipment can send to the mobile 
station tested any commands that do not require that upper protocol layers, which 
do not know about the connection, participate in the communication. Below it is 
simply assumed that the test equipment sends a start comparison and processing 
command START 306 which may include various identifiers, e.g. to specify the 
point in the mobile station tested at which the statistical processing of errors should 
be carried out. For the test equipment to be able to verify that a message sent by it 
has been received it advantageously starts a timer in connection with the sending, in 
which case the mobile station must send an acknowledge before the timer expires. 
The mobile station acknowledges the message using an acknowledge message ACK 
307. The mobile station activates 308 the test loop in a certain time after sending the 
acknowledge. 

When the test loop has been activated at the mobile station tested, the test equip- 
ment can start to send test data, i.e. blocks of a pseudorandom test sequence packed 
into downlink frames such that errors are generated in said blocks in a known 
30 manner. To that end, the test equipment produces 309 a first test sequence, gener- 
ates 3 10 known errors in it, and sends 3 1 1 the resulting second test sequence to the 
communication device tested. The communication device tested produces 312 a 
third test sequence corresponding to the first test sequence and compares 3 13 the 
second test sequence to the third test sequence in order to detect the differences 
35 between the test sequences. The mobile station tested responds to the test equipment 


15 


20 


25 
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by sending to it information that represents errors detected in the received signal. 
This is depicted by an arrow 314 in Fig. 3. As the object is to test the detection of 
errors at the mobile station, the test data is advantageously sent to the mobile station 
at a relatively high signal strength and under optimal signal propagation conditions 
5 so that no errors are likely to be generated in the test data during the transmission. 

Arrows 3 15 and 3 16 depict the sending of test data at different "error levels". Errors 
can be generated in the test data e.g. in greater or smaller quantities, or the errors 
may follow various occurrence patterns (regularly/irregularly, evenly/burstily etc.). 
The invention does not limit the actual placement of errors in the test data. Arrow 
10 317 depicts how the mobile station tested retransmits information representing the 
errors detected in the received signal. 

When the test loop is active the mobile station compares the received test sequence 
blocks to the locally produced blocks and measures e.g. the bit error ratio or frame 
erasure ratio and compiles statistics of the measurement results in a desired manner. 
15 Complete statistics or information elements representing the reception error status in 
general are sent back uplink to the test equipment. The test equipment receives the 
uplink frames sent by the mobile station and demodulates and deciypts them so that 
the statistical results in the received frame can be processed by the test equipment 

At the end of the test the test equipment may instruct the mobile station to release 
20 the test loop by sending a special command QUIT, depicted by arrow 318 in Fig. 3. 
The mobile station releases the test loop and acknowledges the message with an 
acknowledge message ACK, depicted by arrow 319. In connection with the release 
of the test loop the mobile station returns 320 from the test mode to the normal 
operating mode. 

25 The names and specifications mentioned in this patent application associated with a 
particular system, hardware or message are given by way of example only and do 
not affect the applicability of the invention to all mobile communications systems in 
which a mobile station can operate on data, traffic and control channels. Examples 
of such systems include but are not in any way restricted to the GSM (Global Sys- 

30 tern for Mobile telecommunications) and UMTS (Universal Mobile Telecommuni- 
cation System). The invention can also be modified in many ways without departing 
from the scope of the invention defined by the claims attached hereto. For example, 
in a modification of the invention the activation of a test loop and setting of the 
mobile station into test mode as well as the release of the test loop and returning of 

35 the mobile station into normal mode may be realized in a manner other than through 
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a command sent by the test equipment. It can even be thought that these functions 
are activated manually by setting a switch or connector in the mobile station into a 
desired position. However, from the smoothness of testing and automation perspec- 
tive it is advantageous that these functions can be realized by commands sent by the 
5 test equipment 
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Claims 

1. A method for testing the functioning of a digital communication device by 
means of test equipment, characterized in that it is comprised of steps in which 

- a first test sequence is produced (309), 

5 - known errors are generated (3 10) in the test sequence to produce a second test 
sequence, 

- the second test sequence is transmitted (3 1 1) to the communication device tested, 
-the communication device tested produces (312) a third test sequence corre- 
sponding to the first test sequence, 

10 - the communication device tested compares (313) the second test sequence to the 
third test sequence in order to detect differences between the test sequences, and 

- the communication device transmits to the test equipment information representing 
the differences detected. 

2. A method according to claim 1, characterized in that the communication 
15 device transmits information representing the bit error ratio. 

3. A method according to claim 1, characterized in that the communication 
device transmits information representing the frame erasure ratio. 

4. Test equipment for testing the operation of a digital communication device, 
characterized in that it comprises 

20 - a test sequence generator (204) to produce a test sequence, 

- an error generator (211) to generate errors in said test sequence, and 

- a comparator circuit (212) to compare the errors generated with the errors detected 
by the communication device tested. 

5. Test equipment according to claim 4, characterized in that the error generator 
25 is arranged so as to generate in a test sequence block a predetermined number of 

errors at random positions of said test sequence block. 

6. Test equipment according to claim 4, characterized in that the error generator 
is arranged so as to generate a predetermined bit error pattern. 

7. Test equipment according to claim 4, characterized in that it is adapted so as 
30 to test mobile stations of a digital mobile communications system. 
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